Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive.
نویسندگان
چکیده
Phase space can be constructed for N equal and distinguishable subsystems that could be probabilistically either weakly correlated or strongly correlated. If they are locally correlated, we expect the Boltzmann-Gibbs entropy S(BG) identical with -k Sigma(i) p(i) ln p(i) to be extensive, i.e., S(BG)(N) proportional, variant N for N --> infinity. In particular, if they are independent, S(BG) is strictly additive, i.e., S(BG)(N) = NS(BG)(1), for allN. However, if the subsystems are globally correlated, we expect, for a vast class of systems, the entropy S(q) identical with k[1 - Sigma(i) p(q)(i)]/(q - 1) (with S(1) = S(BG)) for some special value of q not equal 1 to be the one which is extensive [i.e., S(q)(N) proportional, variant N for N --> infinity]. Another concept which is relevant is strict or asymptotic scale-freedom (or scale-invariance), defined as the situation for which all marginal probabilities of the N-system coincide or asymptotically approach (for N --> infinity) the joint probabilities of the (N - 1)-system. If each subsystem is a binary one, scale-freedom is guaranteed by what we hereafter refer to as the Leibnitz rule, i.e., the sum of two successive joint probabilities of the N-system coincides or asymptotically approaches the corresponding joint probability of the (N - 1)-system. The kinds of interplay of these various concepts are illustrated in several examples. One of them justifies the title of this paper. We conjecture that these mechanisms are deeply related to the very frequent emergence, in natural and artificial complex systems, of scale-free structures and to their connections with nonextensive statistical mechanics. Summarizing, we have shown that, for asymptotically scale-invariant systems, it is S(q) with q not equal 1, and not S(BG), the entropy which matches standard, clausius-like, prescriptions of classical thermodynamics.
منابع مشابه
ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملA local approach to the entropy of countable fuzzy partitions
This paper denes and investigates the ergodic proper-ties of the entropy of a countable partition of a fuzzy dynamical sys-tem at different points of the state space. It ultimately introducesthe local fuzzy entropy of a fuzzy dynamical system and proves itto be an isomorphism invariant.
متن کاملNonadditive entropy reconciles the area law in quantum systems with classical thermodynamics.
The Boltzmann-Gibbs-von Neumann entropy of a large part (of linear size L ) of some (much larger) d -dimensional quantum systems follows the so-called area law (as for black holes), i.e., it is proportional to Ld-1. Here we show, for d=1,2 , that the (nonadditive) entropy Sq satisfies, for a special value of q not equal to 1, the classical thermodynamical prescription for the entropy to be exte...
متن کاملAsymptotically Optimal Scalable Coding for Minimum Weighted Mean Square Error
In this paper, we derive an asymptotically optimal multi-layer coding scheme for entropy-coded scalar quantizers (SQ) that minimizes the weighted mean-squared error (WMSE). The optimal entropy-coded SQ is non-uniform in the case of WMSE. The conventional multi-layer coder quantizes the base-layer reconstruction error at the enhancement-layer, and is sub-optimal for the WMSE criterion. We consid...
متن کاملEntropy of infinite systems and transformations
The Kolmogorov-Sinai entropy is a far reaching dynamical generalization of Shannon entropy of information systems. This entropy works perfectly for probability measure preserving (p.m.p.) transformations. However, it is not useful when there is no finite invariant measure. There are certain successful extensions of the notion of entropy to infinite measure spaces, or transformations with ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Proceedings of the National Academy of Sciences of the United States of America
دوره 102 43 شماره
صفحات -
تاریخ انتشار 2005